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1. Introduction and statement of main results 

In their study of connections between topology of order complexes 
and commutative algebra in [6], Bjorner and Welker introduced the 
notion of Rees product of posets, which is a combinatorial analog of 
the Rees construction for semigroup algebras. They stated a conjecture 
that the Mobius invariant of a certain family of Rees product posets 
is given by the derangement numbers. Our investigation of this con- 
jecture led to a surprising new g-analog of the classical formula for the 
exponential generating function of the Eulerian polynomials, which we 
proved in [53] by establishing certain quasisymmetric function identi- 
ties. In this paper, we return to the original conjecture (which was first 
proved by Jonsson |25]). We prove a refinement of the conjecture, which 
involves Eulerian polynomials, and we prove a q-analog and equivariant 
version of both the conjecture and its refinement, thereby connecting 
poset topology to the subjects studied in our earlier paper. 

The terminology used in this paper is explained briefly here and more 
fully in Section [21 All posets are assumed to be finite. 

Given ranked posets P, Q with respective rank functions rp,rQ, the 
Rees product P * Q is the poset whose underlying set is 



with order relation given by < ip2,Q2) if and only if all of the 

conditions 

• Pi <P P2, 

• Qi <Q 12, and 

• rp{pi) - rp{p2) > rqiqi) - rQ(g2) 

hold. In other words, {p2, q2) covers {pi,qi) in P * Q if and only if p2 
covers pi in P and either q2 = qi or q2 covers qi in Q. 



{{p,q) ePxQ : rp{p) > rq^q)} 
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Figure 1. (^3 \ {0}) * C3 



Let Bn be the Boolean algebra on the set [n] := {1, . . . ,n} and C„ 
be the chain {0<l<...<n — 1}. This paper is concerned with the 
Rees product \ {0}) * C„ and various analogs. The Hasse diagram 
of (-B3 \ {0}) * C3 is given in Figure 1 (the pair {S,j) is written as 
with set brackets omitted). 

Recall that for a poset P, the order complex AP is the abstract 
simplicial complex whose vertices are the elements of P and whose k- 
simplices are totally ordered subsets of size k+1 from P. The (reduced) 
homology of P is given by Hk{P) := Hk{AP; C). Bjorner and Welker 
[B] prove that if P is the Rees product of Cohen- Macaulay posets then 
P is Cohen-Macaulay, which means that homology of each interval 
and principal lower and upper order ideal of P is concentrated in its 
top dimension. Hence (-B„ \ {0}) * C„ is Cohen-Macaulay, since both 
Bn \ {0} and C„ are. 

For any poset P with a minimal element 0, let P~ denote the trun- 
cated poset P\{0}. The theorem of Jonsson as conjectured by Bjorner 
and Welker in [6| is as follows. 

Theorem 1.1 (Jonsson [25]). We have 



where dn is the number of derangements (fixed-point-free elements) in 
the symmetric group 6„. 

Our refinement of Theorem II. II is Theorem II. 21 below. Indeed, Theo- 
rem [LT] follows immediately from Theorem II. 21 the Euler characteristic 
interpretation of the Mobius function, the recursive definition of the 
Mobius function, and the well-known formula 



dimif„_i(S„ * Cn) = d, 



(1.1) 




m=0 
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Let P be a ranked and bounded poset of length n with minimum 
element and maximum element 1. The maximal elements of P * 
Cn are of the form (1, j), for j = . . . , — 1. Let Ij{P) denote the 
open principal order ideal generated by (1, j). If P is Cohen-Macaulay 
then the homology of the order complex of Ij{P) is concentrated in 
dimension n — 2. 

Theorem 1.2. For all j = 0, . . . ,n ~ 1, we have 

dim^„_2(/j(P„)) = a„j, 

where an,j is the Eulerian number indexed by n and j; that is anj is 
the number of permutations in (5„ with j descents, equivalently with j 
excedances. 

We have obtained two different proofs of Theorem 11.21 both as ap- 
plications of general results on Rees products that we derive. One of 
these proofs, which appears in |34|, involves the theory of lexicograph- 
ical shellability |3]. The other, which is given in Sections [3] and HI 
is based on the recursive definition of the Mobius function applied to 
the Rees product of P„ with a poset whose Hasse diagram is a tree. 
This proof yields a q- analog (Theorem 11.31) of Theorem 11.21 in which 
the Boolean algebra P„ is replaced by its g-analog, Pn(g), the lattice 
of subspaces of the n-dimensional vector space over the q element 
field ¥q, and the Eulerian number anj is replaced by a g- Eulerian num- 
ber. The proof also yields an ©n-equivariant version (Theorem 11.51) 
of Theorem II. 2[ The proofs of these results also appear in Sections [3] 
and m A g-analog and equivariant version of Theorem 11.11 are derived 
as consequences in Section O 

Recall that the major index, maj((j), of a permutation a G 6„ is the 
sum of all the descents of a, i.e. 

maj(a) := ^ i, 

i:a(i)>a{i+l) 

and the excedance number, exc(o"), is the number of excedances of a, 
i.e., 

exc(cr) := \{i e [n - 1] : a{i) > i}\. 
For n > 1, define the g- Eulerian polynomial 

o-eS„ 

and, let A^^^''^^^{q,t) = 1. For example, 

^maj,exc^^^ t) ;= 1 + (2g + q^ + q^)t + qH\ 
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For all j, the g-Eulerian number CL'^'^^'^^^{q) is the coefficient of P in 
A^^^'^^^{q,t). The study of the g-Eulerian polynomials A^^^''^'^^{q,t) 
was initiated in our recent paper [32] and was subsequently further 
investigated in [331 [131 [111 [151 [H] • There are various other g-analogs 
of the Eulerian polynomials that had been extensively studied in the 
literature prior to our paper; for a sample see [H [21 [HI [TOl [TTl [T71 
[T8l[20l[ai[22l[23l[2l[^[30l[35l[371[38l They involve different 
combinations of Mahonian and Eulerian permutation statistics, such 
as the major index and the descent number, the inversion index and 
the descent number, the inversion index and the excedance number. 

Like B~ * Cn, the g-analog Bn{q)' * C„ is Cohen-Macaulay. Hence 
Ij{Bn{q)) has vanishing homology below its top dimension n — 2. We 
prove the following g-analog of Theorem II. 2[ 



Theorem 1.3. For all j = 0,1, ... ,n — 1, 



(1.2) dim^„_2(/,(5„(g))) = g^^^+^a::>]J'^^^(g-i). 

As a consequence we obtain the following g-analog of Theorem II. 1[ 

Corollary 1.4. For all n > 0, let P„ be the set of derangements in 
&n- Then 

dimi^„_i(5„(g)- * C„) = 5^ ^(^)-maj(.)+exc(.)_ 

The symmetric group ©„ acts on i?„ in an obvious way and this 
induces an action on B~ * Cn and on each Ij{Bn). From these ac- 
tions, we obtain a representation of G„ on Hn^i{B~ * C„) and on each 
Hn-2{Ij{Bn)). We show that these representations can be described in 
terms of the Eulerian quasisymmetric functions that we introduced in 



The Eulerian quasisymmetric function Qnj is defined as a sum of 
fundamental quasisymmetric functions associated with permutations 
in Gn having j excedances. The fixed-point Eulerian quasisymmetric 
function Qn,j,k refines this; it is a sum of fundamental quasisymmet- 
ric functions associated with permutations in having j excedances 
and k fixed points. (The precise definitions are given in Section [2TT1 ) 
Although it's not apparent from their definition, the Qn,j,k, and thus 
the Qn,j, are actually symmetric functions. A key result of [33j| is the 
following formula, which reduces to the classical formula for the expo- 
nential generating function for Eulerian polynomials, 

(1.3) y Qn , ki^Wr'z^ = (l - ^)-^M 

^ ^ ^ ^"'^'''^ ^ H{zt)-tH{zy 
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where H{z) := '^n>o^nZ"', and hn denotes the nth complete homoge- 
neous symmetric function. 

Our equivariant version of Theorem 11.21 is as follows. 

Theorem 1.5. For all j = 0,1, ... ,n — 1, 

(1.4) ch^„_2(/,(5„)) =^Q„,„ 

where ch denotes the Frobenius characteristic and oj denotes the stan- 
dard involution on the ring of symmetric functions. 

We derive the following equivariant version of Theorem II. II as a con- 
sequence. 

Corollary 1.6. For all n > 1, 

n-l 

Chff„_i(5„ * Cn) = UjQnJfi. 

j=0 

The expression on the right hand side of (11.31) has occurred several 
times in the literature (see [33i Sec. 7]), and these occurrences yield 
corollaries of Theorem 11.51 and Corollary 11.61 We discuss three of these 
corollaries in Section [5l One is a consequence of a formula of Procesi 
[2B] and Stanley [SH] on the representation of the symmetric group 
on the cohomology of the toric variety associated with the Coxeter 
complex of ©„. Another corollary is a consequence of a refinement 
of a result of Carlitz, Scoville and Vaughan [9] due to Stanley (cf. 
[33l Theorem 7.2]) on words with no adjecent repeats. The third is a 
consequence of MacMahon's formula [261 Sec. Ill, Ch.III] for multiset 
derangements. 

In Sectional we present type BC analogs (in the context of Coxeter 
groups) of both Theorem 1 1 . 1 1 and its g-analog, Corollary ll.4[ In the type 
BC analog of Theorem II. 1| the Boolean algebra -B„ is replaced by the 
poset of faces of the n-dimensional cross polytope (whose order complex 
is the Coxeter complex of type BC). The type BC derangements are 
the elements of the type BC Coxeter group that have no fixed points 
in their action on the vertices of the cross polytope. In the type BC 
analog of Corollary II. 4| the lattice of subspaces Bn{q) is replaced by 
the poset of totally isotropic subspaces of F^*^ (whose order complex is 
the building of type BC). 

2. Preliminaries 

2.1. Quasisymmetric functions and permutation statistics. In 

this section we review some of our work in [331. 
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A permutation statistic is a function / : |Jn>i (Here N is the 

set of nonnegative integers and P is the set of positive integers.) Two 
well studied permutation statistics are the excedance statistic cxc and 
the major index maj. For a G ©„, cxc(o') is the number of cxcedances 
of a and maj (cr) is the sum of all descents of a, as described above. We 
also define the fixed point statistic fix(cr) to be the number of i e [n] 
satisfying a{i) — i, and the comajor index comaj by 



Remark 2.1. Note that our definition of comaj is different from a com- 
monly used definition in which the comajor index of cr G is defined 
to be ndes{a) — maj(o'), where des((T) is the number of descents of cr. 

For any collection fi, . . . , f,. of permutation statistics, and any n G P, 
we define the generating polynomial 



A symmetric function is a power scries of bounded degree (with co- 
efficients in some given ring R) in countably many variables Xi,X2, ■ ■ ■ 
that is invariant under any permutation of the variables. A quasisym- 
metric function is a power series / in these same variables such that 
for any A; G P and any three /c-tuples (ii > . . . > ik), (ji > . . . > jk) 
and (oi, . . . , Ofc) from P'^, the coefficients in / of Y[l=i ^is Y[l=i 
are equal. Every symmetric function is a quasisymmetric function. We 
write /(x) for any power series f{xi,X2,...). 

Recall that, for n G N, the complete homogeneous symmetric func- 
tion hni'x.) is the sum of all monomials of degree n in xi,X2, ■ ■ ■, and the 
elementary symmetric function e„(x) is the sum of all such monomials 
that are squarefree. The Frobenius characteristic map ch sends each 
virtual ©^-representation to a symmetric function (with integer coeffi- 
cients) that is homogeneous of degree n. There is a unique involutory 
automorphism uj of the ring of symmetric functions that maps hnix) 
to e„(x) for every n G N. For any representation V of Sn, we have 




r 



Ay''^{t„...,tr) EH^' 





where sgn is the sign representation of &. 
For n G P and S* C [n — 1], define 




ii > . . . > z„ > 1 

3 €S^ij> 
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and let F^ o = 1- Each Fs^n is a quasisymmetric function. The involu- 
tion uj extends to an involution on the ring of quasisymmetric functions. 
In fact, 

^{Fs,n) = F[n-l]\S,n- 

For n G P, set [n] :={!,..., n} and order [n] U \n] by 
(2.2) T<...<rr<l<...<n. 

For 0" = (Ti . . . (T„ G &n, written in one line notation, we obtain W by 
replacing cTj with o7 whenever i is an excedance of a. We now define 
DEX((t) to be the set of all i E [n — 1] such that i is a descent of a, i.e. 
the element in position z of a is larger, with respect to the order (12. 2p . 
than that in position i + For example, if o" = 42153, then a = 42153 
and DEX(a) = {2,3}. 

For nG P, 0<j<?T, — 1 and < A; < n, we introduced in [33] the 
fixed point Eulerian quasisymmetric functions 

Qn,j,k = Qn,j,k{y^) '■= ^ -PbEX(cr),n(x), 

o- € 6„ 
exc(o-) = j 
fix(CT) = k 

and the Eulerian quasisymmetric functions 

n 

Qn,j ■— ^ ^ Qn,i,k- 
k=0 

We also set Qco = Qo,o,o = 1- It turns out that the fixed point Eulerian 
quasisymmetric functions (and therefore the Eulerian quasisymmetric 
functions) are symmetric. 

We define two power series in the variable z with coefficients in the 
ring of symmetric functions, 

H{z) :=5^/i„(x)^«, 

n>0 

and 

E{z) :=5^e„(x)z". 

n>0 

For any n G P, the q-number [n]q is the polynomial 1 + g + . . . + g""^. 
The key result in [33j is as follows. 
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Theorem 2.2 ([33j, Theorem 1.2). We have 
(2.3) Qn,U^Wr^^- {l-t)H{rz) 

n,j,k>0 



H{zt) - tH{z) 
H(rz) 



It is shown in [33] that the stable principal specialization (that is, 
substitution of g*~^ for each variable Xj) of -FDEX(o-),n is given by 

i^DEXM,n(i, g, g', . . . ) = (g; g);^?™"^^^)-^^^^^), 

where {p;q)n '■= YYi=ii^ —pq^~^). Hence 

j,k>0 

Using the stable principal specialization we obtained from Theorem 
12.21 a formula for ^maj,exc,fix pj-gm that formula, we derived the two 
following results. Before stating them, we recall the definitions 



n 
k 



Expg(2;) := En>o^^'^fc' expg(z) := 
Corollary 2.3 ([33j, Corollary 4.5). We have 



[fc],![n-fc],!' 
n>0 [n]q\- 



(2.5) ^^r'J'^^^'fi^(g,t,r) 



[l-tq i)Exp (rz) 



\n\ 



Exp rztg-i) - (tg-i)Exp r^;) 



n>0 L-Jg- — l-qv-i J J—fq\ 

Corollary 2.4 ([33j, Corollary 4.6). For all n > 0, we have 



fix(CT) = k 



q 



comaj((T)^cxc(CT) 



n 
k 



2. ^ 



comaj((T)^cxc(CT) 



Consequently, 



^comaj(o-)^exc((T) 



fc=0 



A; 



2.2. Homology of posets. We say that a poset P is bounded if it has 
a minimum element Op and a maximum element Ip. For any poset 
P, let P be the bounded poset obtained from P by adding a minimum 
element and a maximum element and let P~^ be the poset obtained from 
P by adding only a maximum element. For a poset P with minimum 
element Op, let P~ = P \ {Op}- For x < y m P, let (x, ?/) denote 
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the open interval {z E P : x < z < y} and [x, y] denote the closed 
interval {z E P : x < z < y}. For y E P, hj closed principal lower 
order ideal generated by y, we mean the subposet {x G P '■ x < y}. 
Similarly the open principal lower order ideal generated by y is the 
subposet {x E P : X < y}. Upper order ideals are defined similarly. 

A poset P is said to be ranked (or pure) if all its maximal chains 
are of the same length. The length of a ranked poset P is the common 
length of its maximal chains. If P is a ranked poset, the rank rp{y) of 
an element y E P is the length of the closed principal lower order ideal 
generated by y. 

The Mobius invariant of any bounded poset P is given by 

MP):=/^p(6p,ip), 

where /ip is the Mobius function on P. It follows from a well known 
result of P. Hall (see [IHl Proposition 3.8.5]) and the Euler-Poincare 
formula that if poset P has length n then 

n 

(2.6) M^) = I](-irdim^,(P). 

i=0 

Hence if P is Cohen-Macaulay then for dX\ x <y m P 

(2.7) /ip(x,y) = (-l)^'dim^,((x,i/)), 

where r = rp{y) — rp{x) — 2, and if y = x or y covers x we set 
Hr{{x,y)) = C. 

Suppose a group G acts on a poset P by order preserving bijections 
(we say that P is a G-poset). The group G acts simplicially on AP 
and thus arises a linear representation of G on each homology group 
of P. Now suppose P is ranked of length n. The given action also 
determines an action of G on P * X for any length n ranked poset X 
defined by {a,x)g = {ag,x) for all a G P, a; G X and g E G. For a 
ranked G-poset P of length n with a minimum element 0, the action 
of G on P restricts to an action on P~, which gives an action of G 
on P~ * G„. This action restricts to an action of G on each subposet 

We will need the following result of Sundaram [H] (see ^31 Theorem 
4.4.1]): If G acts on a bounded poset P of length n then we have the 
virtual G-module isomorphism, 

n 

(2-8) 0(-l)'' i^.-2((0,x))Tg,-cO, 

r=0 x&P/G 
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where P/ G denotes a complete set of orbit representatives, Gx denotes 
the stabihzer of x, and denotes the induction of the G^ module 
from Gx to G. Here i^r-2((0,x)) is the trivial representation of Gx if 
X = or X covers 0. 



3. Rees products with trees 

We prove the results stated in the introduction by working with the 
Rees product of the (nontruncated) Boolean algebra -B„ with a tree and 
its g-analog, the Rees product of the (nontruncated) subspace lattice 
Bnil) with a tree. Theorems 14.11 and 14.51 will then be used to relate 
these Rees products to the ones considered in the introduction. 

For n, t G P, let Tj^„ be the poset whose Hasse diagram is a complete 
t-ary tree of height n, with the root at the bottom. By complete we 
mean that every nonleaf node has exactly t children and that all the 
leaves are distance n from the root. The following result, which is 
interesting in its own right, will be used to prove the results stated in 
the introduction. 

Theorem 3.1. For alln,t > 1 we have 

(3.1) dimHn-2{{Bn*Tt,n)~) = tAn{t) 

(3.2) dim#„_2((i?„(g)*Ti,„)-) = tA~^'''^'^{q,qt) 

n-1 

(3.3) ch^„_2((S„*Tt,„)-) = tY,^Qn,jt^- 

j=0 

Corollary 3.2. For all n > 1 we have 

dim^„_2((i?.(g)*C„+i)-) = ^g-maj(.)+cxcH 

o-e6„ 

n-1 

i=o 

To prove (13.11) and (13. 2p . we make use of two easy Rees product 
results. A bounded ranked poset P is said to be uniform if [x, Ip] = 
[l/, Ip] whenever rp{x) = rp{y) (see [3D], Exercise 3.50]). We will say 
that a sequence of posets (Pq, -Pi, • • • , Pn) is uniform if for each k = 
0, 1, . . . , n, the poset Pk is uniform of length k and 

Pk = [x, ipj 



12 SHARESHIAN AND WACHS 

for each x G Pn of rank n — k. The sequences {Bq, . . . , Bn) and 
(Bo^q), . . . , Bn{q)) are examples of uniform sequences as are the se- 
quences of set partition lattices (Ho, . . . , n„) and the sequence of face 

lattices of cross polytopes {PCPq, . . . , PCPn)- 
The following result is easy to verify. 

Proposition 3.3. Suppose P is a uniform poset of length n. Then 
for all t G P, the poset R := {P * is uniform of length n + 1. 

Moreover, if x E P and y E R with rp{x) = rji{y) = k then 

[vAr] = ([x,ip]*Ti,„_,)+. 

Proposition 3.4. Let [Pq, Pi, . . . , P„) be a uniform sequence of posets. 
Then for all t G P, 

n 

(3.4) 1 + J2 Wk{Pn)[k + l]M{Pn-k * Tt,n-ky) = 0, 

fc=0 

where Wk{P) is the number of elements of rank k in P. 

Proof. Let R := (P„ * „)"*" and let y have rank k in R. By Proposi- 
tion [3]3l 

fiR{y, Ir) = /i((P„-fc * Tt,„_fc)+). 

Clearly 

Wk{R) = Wk{Pn)[k+l]t 

for all < A; < n. Hence (13. 4p is just the recursive definition of the 
Mobius function applied to the dual of R. □ 

To prove (13.11) either take dimension in (13.31) or set g = 1 in the proof 
of (0 below. 

Proof of lis. We apply Proposition l3.4l to the uniform sequence (Bo^q), 
Bi{q), . . . , Bn{q)). The number of fc-dimensional subspaces of is 
given by 



Wu{BM) - 

Write finiljt) for l^{.{.Bn{q) * Tt^n)^)- Hence by Proposition [X 



n 
k 



(3.5) 

k=0 

Setting 



n 
k 



[k + l]i/i„_fe(g, t) = -1. 
-1 1 
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and 

fc>0 

we derive from (I3.5P that 

(3.6) F^^t{z) = -exp^{z)G,,t{z)~\ 

If we assume t > 1 we have 



A:>0 

exp (2;) —texp Jtz 



1-t 

We calculate that 

(1 -t) exp (-tz) 



Fg^t{-Z) = -{l-t)-t 



exp J—z) — texp J—tz) 



Using the fact that exp J—z)Exp Jz) = 1, we have 



F,,,(-z) = -(l-t)-t 



(l-t)Exp^(^) 
Exp (tz) - tExp (z) 



It now follows from Corollary 12.31 that for all n > 1 and t > 1, 
(3.7) fin{q,t) = {-ly-h J2 g™>^^jM+^^^('^)f"<'^). 

One can see from (13.51) and induction that fin{q,t) is a polynomial 
in t. Hence since (13. 7p holds for infinitely many integers t, it holds as 
an identity of polynomials, which implies that it holds for t = 1. 

Since the poset {Bn{q) * Tt^n)~ is Cohen-Macaulay, equation (13.21) 
holds. ' □ 

We say that a bounded ranked G-poset P is G-uniform if the follow- 
ing holds, 

• P is uniform 

• Gx = Gy for all x,y E P such that rp{x) = rp{y) 

• there is an isomorphism between [x, Ip] and [y, Ip] that inter- 
twines the actions of Gx and Gy for all x,y E P such that 
rp{x) = rp{y). We will write 

[xAp] =G.,Gy [y,ip]. 

Given a sequence of groups G = (Gq, Ci, . . . , G„). We say that a 
sequence of posets {Pq, Pi, ... , P„) is G- uniform if 

• Pfc is Gfc-uniform of length k for each k 
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• Gk = {Gn)x and Pk =Gfc,(G„), [x, ip„] whenever rp^{x) =n-k. 
For example, the sequence (-Bq, -Bi, • • • , -Bn) is (6oX©n, (3iX©„_i, . . . , © 
6o)-uniform, where the action of (5j x ©„_j on Bi is given by 

(cr, r){ai, . . . , aj = {cr(ai), . . . , o{as)] 

for cr G ©i, r G ©n-i and {ai, . . . , a^} G -Bj. In other words Gi acts on 
subsets of [i\ in the usual way and acts trivially. 
The following proposition is easy to verify. 

Proposition 3.5 (Equivariant version of Proposition . Suppose P 
is a G-uniform poset of length n. Then for all t G P, the G-poset 
R := {P * Tt^n)~^ is G-uniform of length n + 1. Moreover, if x E P and 
y E R with rp{x) = rR^y) = k then 

[y, Ir] =Gy,G. ([x,ip]*Ti,„_fc)+. 

If {Pq, Pi, . . . , Pn) is a (Gq, Gi, . . . , G'„)-uniform sequence of posets, 
we can view Gk as a subgroup of Gn for each k = 0, . . . ,n. For G- 
uniform poset P, let Wk{P', G) be the number of G-orbits of the rank k 
elements of P. The Lefschetz character of a G-poset P of length n > 
is defined to be the virtual representation 

n 

L{P;G) :=0(-im(P). 

j=0 

Note that by (12. 6p the dimension of the Lefschetz character L{P; G) is 
precisely fi{P). 

Proposition 3.6 (Equivariant version of Proposition [3^ . Let {Pq, Pi, . . 
be a (Go, Gi, . . . , Gn)-uniform sequence of posets. Then for all t G P, 

n 

(3.8) lG„©0W^fc(i^n;G„)[A; + l]iL((P„_fc*Ti,„_,)-;G„_fc) \gI_=Q. 

Proof. Sundaram's equation (12. Sp applied to the dual of a G-poset P 
is equivalent to the following equivariant version of the recursive defi- 
nition of the Mobius function: 

(3.9) L((y,ip);G,)Tg,= 0, 

y&P/G 

where L{{y, ip);Gy) is the trivial representation if y = Ip and is the 
negative of the trivial representation if y is covered by Ip. We apply 
(13.91) to the G„-uniform poset R := {Pn * Tt^n)~^- Let y have rank k in 
R. It follows from Proposition 13.51 that 

Liiy, in); (G„),) Tfj„)^= i^((Pn-. * T,,„_,)-; G„_fc) tg., . 
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Clearly, 

for all k. Thus (EH) follows from (EH). □ 

Proof of ( fg. Now we apply Proposition ESI to the (©o x ©n, ©i x 
. . . , Gn X ©o)-uniform sequence (-Bq, -Bi, • • • , Let 

:=chL((5„*rt,„)-;6„). 

Clearly Wk{Bn] &n) = 1- Therefore by Proposition] 



(3.10) ^[fc + l]t/ifcL„_fe(t) = -K. 

Setting 



k=0 



and 



k>0 



we derive from (13.101) that 

(3.11) Ft{z)Gt{z) = -H{z). 

Now if t > 1, 

Gt{z) = ^5^(l-t'=+^)/..z^ 

A:>0 

H{z) - tHjtz) 

and we thus have 

(l-t)H{z) 



We calculate that 

(1 - t)H{-tz) 



(3,13) = 
Using the fact that H{—z)E{z) = 1 we have 

^ ^ ^ ^ E{tz)-tE{z) 
By applying the standard symmetric function involution u, we obtain 



iuFti-z) = -{l-t)-t 



H{tz)-tH{z)' 
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It follows from this and Theorem 12.21 that for all n > 1 and t > 1, 

n-l 

(3.14) uLnit) = {-l)-HY,Qn,jt^ 

j=0 

By (13.101) and induction, L„(t) is a polynomial in t. Hence (13.141) 
holds for t = 1 as well. Since (i?„ * Tt^n)~ is Cohen-Macaulay we are 
done. □ 

4. The tree lemma 

The following result and Theorem 13.11 are all that is needed to prove 
Theorems 11.21 and 11.31 since Bn and Bn{q) are self-dual and Cohen- 
Macaulay. 

Theorem 4.1 (Tree Lemma). Let P be a bounded, ranked poset of 
length n. Then for all t G P, 

n 

(4.1) = -/.((p**T,„)+), 

where P* is the dual of P. 

Before we can prove Theorem 14.11 we need a few lemmas. Set 

R{P) := P * {xo < Xi < . . . < Xn} 

and for i G [n], let Ri{P) be the closed lower order ideal in R{P) 
generated by (lp,Xj). Set 

RtiP) ■.= {{a,x,)eR^{P)■.J>0} 

and 

R;{P):=R.iP)\RnP). 

Lemma 4.2. The posets Rf{P) and /j_i(P)^ are isomorphic. 

Proof. The map that sends {a,Xj) to {a,j — 1) is an isomorphism. □ 

An antiisomorphism from poset X to a poset Y is an isomorphism 
ijj from XtoY*. In other words, ip is an order reversing bijection from 
X to y with order reversing inverse. 

Lemma 4.3. For < i < n, the map ipi : Ri{P) Ri{P*) given by 
%l)i{{a,Xj)) = {a,Xi-j) is an antiisomorphism. 

Proof. We show first that ipi is well-defined, that is, if {a,Xj) G Ri{P) 
then (a, Xi^j) G Ri{P*). For a E P and j G {0, . . . , n} we have (a, Xj) G 
Ri{P) if and only if the three conditions 

(1) < J < z 
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(2) rp(a) >J 

(3) n — rp{a) > i — j 

hold. If (1), (2), (3) hold then so do all of 

(1') 0<i-j<i 

(2') rp* (a) = n — rp{a) > i — j 

(3') n - rp.(a) = rp(a) >j = i- (i-j), 

and (1'), (2'), (3') together imply that (a, G Ri{P*). The map 
■?/'* : Ri{P*) Ri{P) given by ip*{{a,Xj)) = {a,Xi-j) is also well- 
defined by the argument just given, and ipi = i^i'^, so i^i is a bijection. 

Now for {a,Xj) and {b,Xk) in Ri{P), we have (a, Xj) < {b,Xk) if and 
only if the three conditions 

(4) a<pb 

(5) J < k 

(6) rp(6) — rp(a) > k ~ j 

hold. If (4), (5), (6) hold then so do all of 

(4') b <p* a 

(5') i — k < i — j 

(6') rp*(a) - rp*{b) = rp{b) - rp{a) > k - j = {i - j) - {i - k), 

and (4'), (5'), (6') together imply that in Ri{P*) we have {b,Xi-k) < 
(a, Xi-j). Therefore, ipi is order reversing, and the same argument shows 
that ip* is order reversing. □ 

Corollary 4.4. For 1 < i < n we have 



(4.2) /i(/,_i(P))= Yl fiR,iP'){{ip,Xo),{a,Xi)). 

(a,Xi}€R,iP*) 

In case the notation has confused the reader, we remark before prov- 
ing Corollary 14 .41 that the sum on the right side of equality (14. 2 p is taken 
over all pairs (a, Xj) such that a E P with rp(a) < n — i (so rp*(a) > i), 
and that Ip, being the maximum element of P, is the minimum element 
of P* (so (lp,Xo) is the minimum element of Ri{P*)). 
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= - /^i?+(p)('^'(i^'^i)) 

/3eP+(P) 

/^i?,(P)(7, (ip,a;i)) 

7={a,2^o)6P-(P) 

Yl /^P,(P*)(^i((ip.a;i)),V^i(7)) 

7=(a,2^o)eP-(P) 
{a,Xi)eRi{P*) 

Indeed, the first equahty follows from the definition of the Mobius 
function; the second follows from Lemma I4.2( the third follows from 
the definition of the Mobius function and the fact that /i^+(p) is the 

restriction of /iHi(P) to Rf^P) x Rf{P) (as Rf{P) is an upper order 
ideal in i?j(P)); the fourth follows from Lemma [4.31 and the last two 
follow from the definition of tpi. □ 



Proof of Tree Lemma (Theorem\4.1\). The poset Tt^n has exactly P el- 



ements of rank j for each j = 0, . . . , n. Let be the rank function of 
Tt^n and let Ot be the minimum element of Tt^n- 
We have 

/x((P**Ti,0 + ) = - Y /^P-*T,„((ip,OT),«) 

aGP**Tt,„ 
n 

= -Y Y /^^'**rt,„((ip,6T),a), 

where 

P;,,^. := {{a,w) e P* * Tt,n : r^l^) = j}- 
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We have 

Yl t^P**Tt,n{{^p,OT),(y) = ^ /ip.*Tt,„((ip,6r), (a,6T)) 

= y~] /xp>(lp,a) 

aeP* 

= 0. 

Now fix j G [n]. For any w G Tt^„ with rr(ti') = j, the interval 
[Or,w] in Tf n is a chain of length j. Therefore, for any {a,w) G Pn^tjy 
the interval [(Ip, Ot), (a, u^)] in P* *T(_„ is isomorphic with the interval 
[(lp,Xo), {a,Xj)] in Rj{P*). For any a G P*, the four conditions 

• rp.(a) > j, 

• {a,w) G P^ tj for some w G Tt^„, 

• (a, f) G P^^tj for every v G Tt^„ satisfying rxiv) = j, 

• (a,Xj) G Py(P*) 

are all equivalent. There are exactly P elements v G Tt^n of rank j. It 
follows that 

5^ /^p**Tt.„((ip,Or),«) = XI /^iJ,(P*)((ip>a;o), (a,Xj)), 

and the Tree Lemma now follows from Corollary 14. 4[ □ 

Since P„ is Cohen-Macaulay and self-dual, the following result shows 
that Theorem 11.51 is equivalent to (13. 3p . 

Theorem 4.5 (Equivariant Tree Lemma). Let P be a bounded, ranked 
G-poset of length n. Then for all t G P, 

n 

(4.3) t^L(/,_i(P); G) -L{{P* * Ti,„)-; G). 
Consequently, if P is Cohen-Macaulay then for all t eF, 

n 

0t^.^„_2(/,-l(P)) =G^„-l((P**Ti,„)-). 

i=i 

Proof. The proof is an equivariant version of the proof of the Tree 
Lemma. In particular, the isomorphism of Lemma IT2] is G-equivariant, 
as is the antiisomorphism of Lemma 14.31 
The equivariant version of (14. 2 p is 

(4.4) L(/,_i(P); G)= L(((ip, a;o), (a, x,)); tg, • 

{a,Xi)eRi{P*)/G 
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To prove f l4.4p we let f l3.9p play the role of the recursive definition of 
Mobius function in the proof of (14. 2p . 

To prove (14 .Sp we follow the proof of the Tree Lemma again letting 
(13. 9p play the role of the recursive definition of Mobius function, and 
in the last step applying (14.40 instead of (14.20 . □ 

5. Corollaries 

In this section we restate and prove Corollaries 11.41 and 11.61 and dis- 
cuss some other corollaries that were mentioned in the introduction. 

Corollary 5.1 (to Theorem 11.30 . For all n > 0, let Vn he the set of 

derangements in (5„. Then 

dim^„_i(5„(g)- * C„) = J] ^comajW+excW_ 



Proof. Since Bn{q)~ * Cn is Cohen-Macaulay and the number of m- 

n 
m 



-1 1 



dimensional subspaces of is 
for {Bn{q)^ * Cn) U {0, 1} is equivalent to 

n 

dimif„_i(5„(g)"*C„) = ^ 



the Mobius function recurrence 



m=0 



n 
m 



m—l 



j=0 



It therefore follows from Theorem 11.31 that 

n r- 

m ^ ' 
m=0 L -I 9 



d\m.Hn-i{Bn{q) * C„) = ^ 

m=0 

The result thus follows from Corollary [X 
Corollary 5.2 (to Theorem II. 5p . We have 

(5.1) 5^ch^„_i(5-*a 

n>0 

Equivalently, 
(5.2) 



^ ^ ^comaj(CT)+exc((T) 



□ 



1 - Ei>2(^ - 



n-l 



chif„_i(S„ * Cn) = "^UjQnJfi. 

j=0 

Proof. Applying (12.80 to the Cohen-Macaulay ©„-poset B~ * Cn, we 
have 

n m—l 

Hn-i{B~*Cn) =e„ ^{-l)"~^ ^ [Hm-2{lABm)) ® le,_) Tl:xe„_™, 

m=0 j=0 
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where 1g denotes the trivial representation of a group G. From this 
we obtain 

n m~l 

(5.3) ch^„_i(5- * C„) = Yl dlH^^2{Ij{B,n))K-m 

m=0 j=0 

Hence 

n-1 

n>0 n>0 j=0 

It follows from Theorem 11.51 and (12. 4p that 

By setting t = 1 and using the fact that E{z)H{—z) = 1, we obtain 
(EH). Equation follows from 1^ and ([^4]). □ 

We now present some additional corollaries of Theorem 11.51 and 
Corollary 11.61 which follow from the occurrence of the right hand side 
of (II. 3p in various results in the literature. 

Let Xn be the toric variety naturally associated to the Coxeter com- 
plex Cn for the reflection group 6„. (See, for example [7j, for a dis- 
cussion of Coxeter complexes and [TH] for an explanation of how toric 
varieties are associated to polytopes.) The action of on C„ induces 
an action on X„ and thus a representation on each cohomology group 
of Xn- Now Xn is a complex manifold of dimension n — 1, and can have 
nontrivial homology only in dimensions 2j, for < j < n — 1. Using 
work of Procesi [28j, Stanley shows in [39] that 

^ H{zt)-tH{zy 

n>0 j=0 ^ ' ^ ' 

Combining this with Theorem 11.51 and equations (II. 3p and (12.11) . we 
obtain the following result. 

Corollary 5.3 (to Theorem 1 1.5p . For all j = 0, . . . ,n — l, we have the 
following isomorphism of &n-modules 

Hn^2{lABn)) =6„ H^\Xn) Sgn. 

It would be interesting to find a topological explanation for this 
isomorphism, in particular one that extends the isomorphism to other 
Coxeter groups. 
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Another corollary is an immediate consequence of a refinement of 
a result of Carlitz, Scoville and Vaughan [9] due to Stanley (cf. [531 
Theorem 7.2]). 

Corollary 5.4. For all j = 0, . . . ,n — l, let Wnj be the set of all words 
of length n over the alphabet of positive integers with the properties that 
no adjacent letters are equal and there are exactly j descents . Then 

Chi^„_2(-/j (-Byj)) ^ ^ Xw\-^W2 ' ' ' •^Wn- 

The following equivariant version of Theorem 11.11 is an immediate 
consequence of Corollary 15.21 and MacMahon's formula flEl Sec. Ill, 
Ch.III] for multiset derangements. A multiset derangement of order n 
is a 2 X n matrix D = {dij) of positive integers such that 

• dij < dij+i for all j G [n — 1], 

• the multisets {dij : j G [n]} and {d2j : j G [n]} are equal, and 

• dij 7^ d2j for all j G [n]. 

Given a multiset derangement D, we write x^ for 11^=1 ^ij- 
Corollary 5.5 (to Corollary 15.21) . For all n > 1, we have 
(5.4) chHn-i{B-*Cn)= Yl 

where J^Vn^ is the set of all multiset derangements of order n. 

6. Type BC-analogs 

In this section we present type BC analogs (in the context of Cox- 
eter groups) of both the Bjorner-Welker-Jonsson derangement result 
(Theorem ll.il) and its q-analog (Corollary II. 4p . 

A poset P with a Op is said to be a simplicial poset if [Op,x] is a 
Boolean algebra for all x E P. The prototypical example of a simplicial 
poset is the poset of faces of a simplicial complex. In fact, every simpli- 
cial poset is isomorphic to the face poset of some regular CW complex 
(see in ) . The next result follows immediately from Theorem 11.21 and 
the definition of the Mobius function. For a ranked poset P of length 
n and r G {0, 1, . . . , n}, let Wr{P) be the rth Whitney number of the 
second kind of P, that is the number elements of rank r in P. 

Corollary 6.1 (of Theorem 11.21) . Let P be a ranked simplicial poset of 
length n. Then 

n 

fiiP'^n) = ^(-l)'^-W.(P)r!. 

r=0 
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We think of Bn as the poset of faces of a (n — l)-simplex, whose 
barycentric subdivision is the Coxeter complex of type A. Then dn is 
the number of derangements in the action of the associated Coxeter 
group &n on the vertices of the simplex. Let PCPn be the poset of 
simplicial (that is, proper) faces of the n-dimensional crosspolytope 
CPn (see for example O Section 2.3]), whose barycentric subdivision 
is the Coxeter complex of type BC. The associated Weyl group, which 
is isomorphic to the wreath product ©„[Z2], acts by reflections on CPn 
and therefore on its vertex set. Let d^'" be the number of derangements 
in this action on vertices. 

Theorem 6.2. For all n, we have 

dimHn-i{PCP-*Cn)=d^''. 

Proof. It is well known and straightforward to prove by induction on 
n that, for < r < n, the number of (r — l)-dimensional faces of CP„ 
is 2^'("). Corollary 16. II gives 

^,{pcp^Cn) = j2(-^r"'^\%'-- 

r=0 ^ ^ 

Hence since PCP^ is Cohen-Macaulay, we have, 

dimHn-iiPCP- * C„) = ^(-l)"-^2^('''y!. 

r=0 

On the other hand, we may identify the vertices of CPn with elements 
of [n] U [n], where [n] = {1, . . . , n}, so that the action of the Weyl group 
W = &n['^2] is determined by the following facts. 

• Each element w & W can be written uniquely a.s w = {a, v) 
with a e &n and v G 

• Any element of the form (cr, 0) maps i G [n] to cr(z) and i G \n] 
to cr(i). 

• Any element of the form (1, Cj), where Cj is the i^^ standard basis 
vector in Z2, exchanges i and i, and fixes all other vertices. 

It follows that for each S* C [n], the pointwise stabilizer of in ly is 
exactly the pointwise stabilizer of S := {i : i & S} and is isomorphic 
to ©„_|5|[Z2]. Using inclusion-exclusion as is done to calculate dn, we 
get 

^f^ = E(-iy('')2"-^(n-j)!. 
j=o ' 

□ 
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Muldoon and Readdy [27] have recently obtained a dual version of 
Theorem 16.21 in which the Rees product of the dual of PCP„ with the 
chain is considered. 

Next we consider a poset that can be viewed as both a g-analog of 
PCPn and a type BC analog of Bn{q). Let (■, ■) be a nondegenerate, 
alternating bilinear form on the vector space F^". A subspace U of 
Fg" is said to be totally isotropic if (m, f ) = for all m, f G U . Let 
PCPn{q) be the poset of totally isotropic subspaces of F^". The order 
complex of PCPn{q) is the building of type BC, naturally associated 
to a finite group of Lie type B or C (see for example ^Tj Chapter V], 
[3T1 Appendix 6]). Thus we have both a g-analog of PCPn and a type 
BC analog of Bn{q) (since the order complex of Bn{q) is the building 
of type A). 

Clearly PCPn{q) is a lower order ideal of B2n{q)- 

Proposition 6.3. The maximal elements of PCPn{q) all have dimen- 
sion n. For r = 0, . . . ,n, the number of r- dimensional isotropic sub- 
spaces o/F^" is given by 



Wr{PCPn{q)) 



n 
r 



(g" + l)(g"-^ + l)---(g"-^+^ + l 



Proof. The first claim of the proposition is a well known fact (see for 
example |3T| Chapter 1]). The second claim is also a known fact; we 
sketch a proof here. The number of ordered bases for any /c-dimensional 
subspace of F^" is 

k-1 



j=0 

On the other hand, we can produce an ordered basis for a fc-dimensional 
totally isotropic subspace of Fg"' in k steps, at each step i choosing 
Vi G (f 1, . . . , fi-i)"*" \ (fi, . . . , f j-i). The number of ways to do this is 

k-1 



2n-j _ 



j=0 

and the proof is completed by division and manipulation. □ 

It was shown by Solomon that PCP„(g) is Cohen-Macaulay. 
Hence so is PCPn{q)~*Cn- We will show that the dimension of 
Hn-i{PC Pn{q)~ * Cn) is a polynomial in q with nonnegative integral 
coefficients and give a combinatorial interpretation of the coefficients. 
We first need the following q-analog of Corollary 16.11 We say that a 
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poset P with Op is g-simplicial if each interval [6p,x] is isomorphic to 
Bj{q) for some j. 

Corollary 6.4 (of Theorem II. 3p . Let P he a ranked q-simplicial poset 
of length n. Then 



,comaj{(T)+exc{(T) 



r=0 



Theorem 6.5. For all n > 0, let dn{q) := E g^°'"^j('^)+<=^<<^) . Then 
(6.1) 

n p -1 n 

dimH„-i{PCP„{q)- * C„) = Y. I / n (1 + ^«-'^(^)- 



k=0 



-I g 



=k+l 



Consequently, dim Hn-i{PCPn{q) * Cn) is a polynomial in q with non- 
negative integer coefficients. 



Proof. We have by Proposition 16. 3[ Corollary 16.41 and the fact that 
PCPn{q)~ * Cn is Cohen-Macaulay, 



dim^„_i(PCP„(g)- * C„) = 5^(-l) 



j=Q 



n 
3 



n (1 + gO a„_,(g), 

Q i=j+l 

where a„(g) := J^af^Bn q'^°^^^^°'^~^'^^^^"\ On the other hand by Corol- 
lary [2]ll the right hand side of (16. ip equals 



E 

fc=0 



n 
k 



n n—k 
i=fc+l m=0 



n — k 
m 



0.n-k-m{<l) 



^a„_j(g)^ 



i>o 



i>o 



fc>0 

3 



n 
k 



i=k+l 



n — k 
j - k 



9 /c>0 



+1 

n. 



-I g i=k+i 



Thus to prove (16. ip we need only show that 

n 

f n (1 +«')(-!)'• 



fc>0 



3 
k 



i=fc+l 



holds for all n and j. By Gaussian inversion this is equivalent to, 

n 



fc>0 



3 

k 



i=A;+l 
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which is in turn equivalent to, 



(6.2) q^\-iy = Y. 

k>0 



J 
k 



9 i=k+l 

To prove (16.21) we use the q-binomial formula, 



n-l 



=0 



fc>0 '- 



n 
k 



Set y = 1 and use Gaussian inversion to obtain 

fc-1 



fc>0 



fc>i 

Now set a; = g" to obtain 



n 
k 



-I 1 



i=0 



fc>0 '- 



E 

fc>0 



n 
k 

n 
k 



fc-1 



fc-1 



j=0 



□ 



Using the standard identification of elements of &n^2\ with barred 
permutations (i.e., permutations written in one line notation with some 
subset of the letters barred), the derangements of Theorem 16.21 are the 
barred permutations a = ai - ■ ■ an for which Oi ^ i for all z G \n\. Let 
P^*" be the set of such barred permutations. If a is a barred permu- 
tation, let |cr| be the ordinary permutation obtained by removing the 
bars from a. For o G "P^f*", let a be the word obtained by rearranging 
the letters of a so that the fixed points of |(t|, which are all barred in 
(T, come first in increasing order with bars intact, followed by subword 
of nonfixed points of |cr| also with bars intact. Now let 5* be the set of 
positions in which bars appear in a . Define the bar index, bnd(a) of 
a to be ^jg^i. For example if cr = 3254617 then a = 2473561 and so 
bnd(cj) = 1 + 2 + 3 + 4 + 6. 

Corollary 6.6. 

dim Hn-l{PC Pn{qy *Cn) = J] ^comaj(H)+exc{kl)+bnd(a) 
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Proof. By Corollary 12.41 we have, 



^comaj { I o- 1 ) +exc ( I o- 1 ) ^bnd (cr) 



^==0 cr G e„ j=A;+l 
fix((7) = k 



k=0 



i=k+l 



Now set p = g and apply Theorem I6.5[ □ 
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